Overview

From meeting on 2/21/07 with Brian Schlining, Danelle Cline, and Duane Edgington

Issues Assigned to 1.0M1

Tasks

EITS

• Create simulator that 'fetches' video and copies it to a movie archive
  • The arrival of a movie in the archive should kick off the processing
• Movies need to have a unique ID. Will this output be something like what is currently used in the EITS testing directory. For example, will an Id be like 09232005_054508. This could be used to build a URL to the movie and XML output, using some base URL reference and the id.
• Associate movie with time of recording
  • Are we going to use UTC time as the timecode? Where will we encode/store date information?
• Specify timecode encoding. See VARS/ETIS Data Handling
• Investigate ASF media container format
  • ASF is a windows container around MPEG-4
  • Is it acceptable for our workflow and use by VARS?
    • In short...No.
  • Can QuickTime read it?
    • Not really. On Mac if you install Flip4Mac and the DivX codec it's supposed to be able to read it. It seems to barf still. Opening the test movie that Lee sent us in VLC indicates that there are some funkiness with the ASF file.
• Use QuickTime (.mov) as the preferred container
  • Add TimeCode Track
  • Add streaming hint to container

AVED

• Finish editor UI
• Populate XML with movie reference. The movie reference is contained in the AVED SourceMetaData element see . For the EITS milestone1 experiment, it will be e.g.file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi" rel="nofollow"linktype="raw" linktext="http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1. For the EITS milestone1 experiment, it will be e.g.file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi">http://oceana.shore.mbari.org:8081/download/attachments/927/Aved+Event+File+Schema+-+Vers+1C.xsd?version=1. For the EITS milestone1 experiment, it will be e.g.file:/nanomiaRAID/EITS/milestone1/video/20061031T112213.avi
• Finish workflow to execute AVED. Using Condor workload management system http://www.cs.wisc.edu/condor/
• Integrate new segmentation.
  • Build on cluster
• What should/does transcode system look like? See EITS Video.

Activity Diagram of the AVED Processing

For AVED testing, a short 1 minute AVI clip is generated and processed through the Condor  workflow software. This is done through a series of "jobs". The AVI use the same audio and video codec as the final EITS experiment.  This diagram shows the activities on particular servers (each represented as different horizonal color), inputs and output files, and the general data storage locations for this milestone.  Click on the thumbnail for a larger view.

AVED Deployment Diagram

This is the deployment diagram that describes the servers used in AVED processing.  There are 10 Linux Servers (including the 8 cluster nodes) and 1 Windows desktop PC described here. Click on the thumbnail for a larger view.

VARS

Load Events XML into VARS

How will we reference the source movie file?

Some options are:

1. Setup webserver and reference as URL
   • Translate XML movie identifier to URL or other file reference?
   • Movies would be fetched to local cache. QuickTime handles caching.
   • Tried this approach. Movie at http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09232005_054508/09232005_054508/09232005_054508.mov does not work. Movie at http://nanomia.shore.mbari.org/EITS_testing/RESULTS/09222005_153508proc/09222005_153508proc/09222005_153508proc.mov works fine. May be due to the size. This implies that the streaming hint may be very important to add to the QuickTime container. My current approach will be to fetch the movie to a local temp file. This will be slow but we can optimize it when we have Movies with streaming hints added. Danelle Cline These movies are uncompressed, so fetching these over web server, even in MBARI's fast network won't work well. Jerome and I will work on converting these file to a streaming format and put them on a streaming server in my office so you can test that. For streaming, you can use the RTSP URL or it can be tunnelled through HTTP.. I think there was some confusion here - these examples were UNCOMPRESSED video converted from a video codec the EITS team sent us that we couldn't transcode in Linux, so we converted them to a format we could process.  Fortunately, we will not be working with uncompressed video in the EITS experiment. We will be working with compressed video in the final experiment , and the codec is supported in Linux. This means the files will be smaller, and shouldn't be too difficult to mov around, although hinting them to optimize playback is required because they will be long (30 minutes ?).
   • Brian Schlining In order to simplify the VARS side of the processing, movies are required to have a Time-code track. If they don't they will not be loaded into VARS. In order streaming to work, we need to add the TimeCode track and hint that track for streaming or it won't be visible. There's no way to do this from QT4J, so it will need to be done before the Events XML loader tries to read the movie file. Investigating a method to add hints from Java so that we can integrate it into the eits-db scripting package.
   • Brian Schlining I tested VARS (from Mac OS X, not windows) against http://mbari649.shore.mbari.org/data/20050923T043059.mov, which is not served by a streaming server. This movie contains both a TimeCodeTrack and streaming hints. It worked fine with VARS (e.g. A Streaming server is not needed but streaming hints are)

Modify to annotate movie files

Testing server: mbari649.shore.mbari.org

• Installed servers
  1. Apache 2
     • Directory for served documents - /Library/WebServer/Documents.
     • Raid on nanomia has been automounted on /private/var/automount/Network/RAID. However, I haven't been able to configure permissions correctly so that the web server can access this directory. The httpd.conf is correctly configured, but I mounted the directory using my account, Apache is probably tryign to read it using a local user account.
  2. MySQL 5.0
     • For EITS work the user account to use is eitsuser with password eits4mbari
  3. Darwin Streaming Server
     • Administration console - 127.0.0.1:1220 (I'm the current admin)
     • Directory for served movies - /Library/QuickTimeStreaming/Movies
     • Example URL: rtsp://mbari649.shore.mbari.org:7070/sample_300kbit.mov
     • Initial testing shows that a streaming server is not required

Events XML Handling in EITS.png (image/png)
Events XML Handling in EITS.png (image/png)
Events XML Handling in EITS.png (image/png)
Events XML Handling in EITS.png (image/png)
EITS Milestone 1.png (image/png)
EITS AVED Deployment Milestone 1.jpg (image/pjpeg)
EITS AVED Deployment Milestone 1.jpg (image/pjpeg)
EITS AVED Processing Activity Milestone1.jpg (image/pjpeg)